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! Abstract 

We identify a practical vector quantizer design problem where any fixed-length quan- 
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tizer (FLQ) yields non-zero distortion at any finite rate, while there is a variable-length 
quantizer (VLQ) that can achieve zero distortion with arbitrarily low rate. The problem 
arises in a t x 1 multiple-antenna fading channel where we would like to minimize 
the channel outage probability by employing beamforming via quantized channel state 
information at the transmitter (CSIT). It is well-known that in such a scenario, finite-rate 
FLQs cannot achieve the full-CSIT (zero distortion) outage performance. We construct 
VLQs that can achieve the full-CSIT performance with finite rate. In particular, with 
P denoting the power constraint of the transmitter, we show that the necessary and 
sufficient VLQ rate that guarantees the full-CSIT performance is 0(1/P). We also discuss 
several extensions (e.g. to precoding) of this result. 

I. Introduction 

High-resolution quantization theory says that for continuous sources with squared- 
error-like distortion measures, the distortion-rate functions for fixed-length quantizers 
(FLQs) and variable-length quantizers (VLQs) exhibit the same asymptotic behavior 
where the quantization rate R is measured in bits per source sample pQ. 
This similarity in terms of the asymptotic behavior may not hold however for other 
distortion measures [2J Section VII]. In fact, one can easily construct distortion 
measures for which every finite-rate FLQ has non-zero distortion, while there is a 
VLQ that achieves zero distortion with finite rate. We first give an example for a 
^ ; discrete source and then extend it to the continuous case. 

Example 1. Consider a discrete source over an infinite alphabet {x n : n G N} with the 
Hamming distortion measure h(x,x) = l(x ^ x) and probabilities p n = P(x„), n G 
N that satisfy YlnenPn — 1; Pn > 0, and p n G O(^). Any finite-rate FLQ then 
clearly has non-zero distortion. On the other hand, let Q be an infinite-level VLQ with 
Q(x n ) = Xn o,nd codeword lengths i n = |~21og 2 (n + 1) + 1] (It is straightforward to 
show that J2 n en2~ en — 1; an d therefore, the code is prefix-free). Since £ n e O(logn) 
and p n G 0{\), the quantization rate J2 n &N^nPn is finite. ■ 

The following is a continuous analogue of the discrete scenario in Example [U 

Example 2. Let p n and x n be as defined in Example^ For scalar quantization of 
the uniform distribution on [0, 1], we construct a binary distortion measure do{x,x) : 

This work was supported in part by the NSF Award CCF-1218771. 
Let f{x) £ 0(g(x)) if for sufficiently large x, f(x) < ag(x) for some a > 0;/(a;) £ o(g(x)) if for sufficiently 
large x, f(x) < eg(x), Ve > 0; and f(x) € 6(3(0;)) if f(x) € 0{g(x)) and f(x) $ o(g{x)). 
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[0, l] 2 — > {0,1} in the following manner: Let X n , n G N be an arbitrary sequence 
of mutually disjoint subsets of [0, 1] with UneN^n = [0, 1], fi(X n ) = p n , where //(•) 
denotes the Lebesgue measure. We set do(x,x) = whenever we have x 6 X n and 
x = x n for some n 6 N. Otherwise, we set d (x,x) = 1. Similarly, any finite-rate 
FLQ has positive distortion, while there is a finite-rate VLQ with zero distortion. ■ 

Example [2] shows that even for continuous sources, FLQ and VLQ distortion-rate 
functions may behave very differently. Given enough freedom, one can craft other 
distortion measures with the same (or perhaps even more "dramatic") consequences. 
Crafting, however, often results in an artifical distortion measure such as the one in 
Example [2J It is not clear whether such measures play any role in practical problems 
and deserve a thorough investigation. One goal of this paper is to demonstrate that 
in fact, they do appear in the context of multiple-antenna communication systems. 

In multiple-antenna systems, the availability of channel state information (CSI) 
at the transmitter and/or the receiver can greatly improve the quality of communi- 
cations. Typically, the receiver can acquire the CSI via training sequences from the 
transmitter. Obtaining CSI at the transmitter (CSIT) is however more difficult and 
generally requires feedback from the receiver. In practice, the feedback link has a 
finite bandwidth, which means that only a finite number of feedback bits per channel 
state can be utilized for feedback. One way to model such a limited feedback scenario 
is to formulate it as a source coding problem. The core element of such a formulation 
is a (channel) quantizer that specifies (i) for each channel state, the finite sequence 
of feedback bits to be fed back by the receiver; and (ii) for each such sequence, the 
codeword (e.g. a beamforming vector) to be employed by the transmitter. 

A great deal of scholarly work has been done on the design and performance 
analysis of channel quantizers for multiple antenna systems; a comprehensive overview 
can be found in [3]. In particular, beamforming with limited feedback has been 
extensively studied with different approaches based on Grassmannian line packings 
[1], [5], vector quantizer design algorithms [E] [E], high resolution approximations [9], 
random vector quantizers [T0j, and several other techniques [TTj [T5]. 

Most of the previous work on finite-rate CSI feedback has been based on FLQs, in 
which the number of feedback bits per channel state is a fixed nonnegative integer. In 
general, different binary codewords of different lengths can be fed back for different 
channel states, resulting in a VLQ structure. 

In this work, we consider the VLQ design problem for a multiple- input single- 
output (MISO) system with t transmitter antennas and a short term power constraint 
P at the transmitter. We assume a slowly fading channel model in which the channel 
realizations vary independently from one fading block to another while within each 
block they remain constant. We also assume that the receiver has full-CSI, while the 
transmitter has only partial CSI provided by the receiver via error-free and delay- 
free feedback channels. The partial CSI is in the form of quantized instantaneous CSI 
provided by a VLQ. Our performance measure is the outage probability. 

Outage-optimal FLQs for MISO channels have been well-investigated [TJ, [TTj . and 
it is known that finite-rate FLQs cannot achieve the full-CSIT performance. We give 
an explicit construction of a VLQ that achieves the full-CSIT performance with rate 
Co(p + pt)) where C is a constant that is independent of P. Note that Co(-p + -kt) — > 
in the high signal-to-noise ratio (SNR) regime P — > oo. We also show that such a 
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decay 0(p) of the required feedback rate is asymptotically the best possible up to 
constant factors: For sufficently high P, the performance of any VLQ with rate o(-p) 
is strictly worse than the full-CSIT performance. 

The rest of this paper is organized as follows: In Section [Til we gi ye a formal 
description of the system model, the outage probability performance measure, and the 
variable- length channel quantizers. In Section [TTTl we state and prove our main results. 
Finally, in Section IIVI we draw our main conclusions and discuss some extensions. A 
technical proof is provided in the appendix. 

II. Preliminaries 

A. System model 

Consider a t x 1 MISO system. Denote the channel from transmitter antenna i 
to the receiver antenna by hi, and let h = [ hi ■■■ h t } T G C' xl represent the 
entire channel state. We assume that the entries of h are independent and identically 
distributed as CN(0,1). The transmitted symbol s G C txl and the received symbol 
y G C have the input-output relationship y = s T ^/Ph + rj, where the noise term 
1] ~ CN(0, 1) is independent of h. We require E[||s|| 2 ] < 1 as a result of the short-term 
power constraint of the transmitter. 

B. The outage probability performance measure 

For a fixed h, suppose that input symbol s is chosen as s ~ CN(0, xx^) with 
||x|| < 1 due to the short-term power constraint. This transmission strategy is known 
as beamforming (along the beamforming vector x). The channel capacity under 
this strategy is log 2 (l + |(x, h)\ 2 P) bits per channel use. For a given target data 
transmission rate p, we say that an outage event occurs if log 2 (l + |(x, h)\ 2 P) < p. 

When h is random, the transmitter can choose a different beamforming vector 
for different h. In this case, we define the outage probability as the fraction of 
channel realizations for which outage events occur. Formally, consider an arbitrary 
(measurable) mapping M : C* ->■ X m where X BF = {x G C* xl : ||x|| = 1} is the set of 
all feasible beamforming vectors (vectors with norm less than 1 can be shown to be 
suboptimal). Then, the outage probability with mapping M can be expressed as 

OUT(M) ^P(|(M(h),h)| 2 < a) with a = (2 p -l)/P. (1) 

In the extreme case where the transmitter knows h perfectly (the full-CSIT case), 
it can choose an optimal beamforming vector, say Full(h) for a given h. In such 
a scenario, we have | (Full(h), h) | < ||Full(h)|| ||h|| < ||h||, and the upper bound is 
achievable by choosing Full(h) = h/||h||. This gives us OUT(Full) = P(||h|| 2 < a). 

At the other extreme, the transmitter may have "no idea" about h, in which case 
we say that we have a no-CSIT system. In such a scenario, the transmitter has to 
use a single beamforming vector, say xo G X BF , for all the channel states. This gives 
the outage probability P(|(x ,h)| 2 < a), which can be shown to be independent 
of xo. We may therefore set Open(h) = ei, Vh without loss of optimality, where 
e x = [ 1 • ■ ■ ]t. We have OUT(Open) = P(|/ii| 2 < a). 

We now consider the case where the transmitter has partial CSI via feedback from 
the receiver. Using a source coding formulation, such a partial CSI system can be 
described by a channel quantizer as we explain in what follows. 
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C. The channel quantizer 

Let I C N be an index set. We use the notations {a n }x and {a n : n G X} 
interchangeably to represent a set whose elements are the real numbers a n , n G X. For 
X = N, we ignore the subscript and write {a n } instead of {a n }N- Similar definitions 
hold for sets of vectors, collection of sets, etc. 

For a given index set X, let {x n }j be a set of quantized beamforming vectors with 
{ x n}x C X BF . Also, let {S n }x with £ n C C*, Vn 6 Nbea collection of mutually disjoint 
measurable subsets of C* with {Jn&Zn = C*. Finally, let {b n }x be a collection of 
feedback binary codewords with {b n }x C {0, 1}*, where {0, 1}* = {e, 0, 1, 00, 01, . . .} 
is the set of all binary codewords including the empty codeword e. We assume b m ^ b n 
whenever m ^ n. We call the collection of triples 

Q := {(x n , £ n , b n )} x (2) 

a quantizer Q for the beamforming strategy. We call Q an infinite-level quantizer if X 
is an infinite set. Otherwise, we call Q an |X| -level quantizer. 

The quantizer definition in §Z§ immediately induces a feedback transmission scheme 
that operates in the following manner: For a fixed channel state h, the receiver feeds 
back the binary codeword b n , where the index n here satisfies h G S n . Such an 
index n always exists and is unique as S n , n G N is a disjoint covering of C. The 
transmitter recovers the index n and uses the corresponding beamforming vector x n . 
The recovery of n by the transmitter is always possible since b n s are distinct. We 
write Q(h) = x„ whenever h G S n to emphasize the quantization operation. We call 
the set {x n }x the quantizer (or beamforming) codebook. 

For any b G {0, 1}*, let L(b) denote the "length" of b. We allow L(b) = oo if b is 
not of finite length (For example, L(e) = 0, L(01) = 2, L(1010 • • • ) = oo). A quantizer 
Q is called an FLQ if L(b m ) = L(b n ), Vm, n G X. Otherwise, we call Q a VLQ. 

A quantizer Q is thus a mapping C* — > {x n }j supplied with a feedback binary 
codeword b n for each x n . Treated solely as a mapping, it is a special case of the 
mapping M : C* — > X BF discussed in the previous section with the requirement of 
a countable image {x n }j. According to ([TJ, we can therefore calculate the outage 
probability with Q as 0UT(Q) = P(|(Q(h), h)| 2 < a), which does not depend on b n . As a 
result, we do not specify/mention b n when we would like to talk only about the outage 
performance of a quantizer and write {x„,£ n , -}j instead. The binary codewords b n 
however determine the rate R(Q) of the quantizer Q via R(Q) = Z)nexP(h G S n )L(b n ). 

Clearly, we measure the quality of the quantizer by the outage probability it 
provides. We can also define the distortion measure d(h, x) = 1(| (x, h) | 2 < «V ||h|| 2 < 
a) = l(|(x, h)| 2 < a) — l(||h|| 2 < a) that measures the quality of reproduction of 
the source/channel sample h by x. For a given quantizer Q, the expected distortion 
E[d(h, Q(h))] is nothing but the quantity 0UT(Q) — OUT(Full). Therefore, minimizing 
the expected distortion is equivalent to minimizing the outage probability with Q. 

Note that d(h, x) G {0, 1} for any h and x, and thus d(h, x) is a binary-distortion 
function for a continous source. In this respect, it resembles the function do(x,x) in 
Example [2J Also similarly, for any given reproduction level x, there is a set of source 
samples, say % x , that has positive probability and satisfies Vh G "H x , d(h, x) = 0. 
We thus expect VLQs to signficantly outperform FLQs for the distortion measure 
d(h, x). On the other hand, it is not clear how to design a good VLQ for d(h, x), 
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as unlike Example [2J the question of how to design the quantizer codebook and the 
encoding regions is non-trivial. 

III. Finite- rate VLQs that achieve minimum outage 

We start with the design of the encoding regions for a given codebook. To gain 
initial insight on the problem, we first review the standard encoding rule used for 
FLQs and discuss why it will not work in the case of VLQs. 

A. The standard encoding rule 

Let B = {x , . . . ,xat_i} be a finite-cardinality codebook. A standard practice (see 
e.g. [7], [II]) is to work with the quantizer Q#(h) = arg max xgB | (x, h) | 2 , which chooses 
the beamforming vector (with ties broken artbirarily) in B that is "closest" to h. In 
fact, it can be shown that is an optimal quantizer for the codebook B in the sense 
that for any quantizer Qg : C* — > B, we have OUT(Qg) < OUT(Qg). 

One way to design a VLQ might be to keep the standard encoding rule but instead 
use a variable-length code instead of a fixed-length code. There are two problems with 
this approach. The first problem, which is of a rather technical nature, is that the 
standard encoding rule is not well-defined for infinite-level quantizers as a maximizer 
may not exist for countably infinite codebooks. The second and more important issue 
is that even for a finite cardinality codebook, this rule is quite ill-suited for variable- 
length quantization as we shall discuss in the following. 

It is well known that the beamforming vectors in a well-designed codebook should 
be "evenly distributed" on X BF (A formal treatment of this argument gives rise to e.g. 
Grassmannian codebooks [1]). For such a well-designed codebook B = {x , . . . , x A r_ 1 } 
and an index i G {0, . . . , N — 1}, the standard encoder picks Xj if G {0, . . . , N — 
1}, |(xj,h)| > |(x n ,h)|. Due to the even distribution of codevectors, this results in 
quantization cells with roughly equal probability j-. In such a scenario, it can be 
shown that even the best variable-length code results in a VLQ rate of log 2 N (up to 
an additive constant). Hence, VLQs designed via the standard encoding rule cannot 
achieve the full-CSIT performance with finite rate since we need N — > oo (In fact, 
we can already design a rate-[log 2 N~\ FLQ that is optimal for B; a VLQ with almost 
the same rate is superfluous). We thus first introduce an alternate encoding strategy. 

B. An alternate encoding rule 

For any given beamforming vector x G X BF , let O x = {h : |(x, h)| < y/a} denote 
the channel states for which using x results in outage. Also, let 0£ denote the 
complement of O x . The simple but key observation is that the standard encoder 
is "excessively precise" as it always picks the (intuitively best) beamforming vector 
in {xo, . . . ,Xjv-i} that is closest to h. In fact, without loss of optimality in terms 
of the outage probability, for any j G {0, . . . , N — 1}, the transmitter can use Xj 
whenever using Xj does not result in outage (i.e. whenever h G C Xj )- It can also use Xj 
whenever all the beamforming vectors in the codebook result in outage (i.e. whenever 
h G f)n=o Cx„), as using any other beamforming vector in {x , . . . , Xjv-i} would result 
in an inevitable outage anyway. In other words, for the set C Xj U fl^To 1 ^x n of source 
samples, choosing x 3 - instead of the beamforming vector that is closest to h will not 
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change the distortion. We exploit this property of the distortion measure to design 
a new encoding strategy that yields very low rates without sacrificing performance. 
Formally, for a given arbitrary infinite beamforming codebook {x n }, we set 

£ * = <^ u n e>*„, (3) 

and use xo as the beamforming vector whenever h G £q. We have now allocated the 
part Sq of the entire channel state space C*. In general, for any n G N — {0}, we set 

n-l 

£* n = o c Xn nf)o Xk , (4) 

k=0 

and use x n whenever h G £*. For any nGN- {0}, by definition, £* consists of 
channel states for which using the beamforming vector x n does not result in outage 
while using any of the preceding beamforming vectors x , . . . , x n _i results in outage. 

It follows immediately from the definitions that {£*} is a disjoint collection of 
measurable sets that cover C*. We may therefore define the infinite- level quantizer 
{x„,£*, ■}. Let us now calculate the outage probability with this quantizer. Mean- 
while, we show that it is also in fact an optimal quantizer for the codebook {x n }. 

Proposition 1. Let {x n } be a given codebook. For any quantizer Q : C* — > {x n } ; we 
have OUT(Q) > P (h G n ieN ^xj ■ In particular, 0UT({x n , S*, ■}) = P (h G C\i& O^), 
and therefore {x n ,£*, ■} is an optimal quantizer for the codebook {x n }. 

Proof: For any quantizer Q = {x n , £ n ,-}, the event h G H n eN ^x„ results in 
outage regardless of how {£ n } is chosen. This proves the lower bound. As for the 
quantizer {x n , £*,■}, by construction, an outage event happens if and only if h G 
= ^x U HngN^xn, fc> r which the transmitter uses the beamforming vector x . 
Since x does not result in outage when h G XQ , we have the desired result. ■ 

For a finite-cardinality codebook {x n : n = 0, . . . , iV — 1}, we replace the "N" in the 
right-hand side of (jHJ) by "{0, . . . , iV — 1}," and follow the same steps (e.g. Proposition 
[T]) to construct an optimal quantizer for codebook {x„ : n = 0, . . . ,N — 1}. 

We now argue that with an appropriate choice for {x n } and the feedback binary 
codewords {b n } the quantizer Q/ x \ can achieve OUT(Full) with finite rate. We first 
give a "proof by figures." For this purpose, the regions O x = {h : | (x, h) | < \fa 
and are illustrated in Fig. [Ta] for some a > 1. In the figure, the entire space 
C is represented by the interior of the outer "disk" ||h|| < oo that is bounded by 
the "circle" ||h|| = oo. The inner disk represents the sphere ||h|| 2 < a. In fact, 
the probability that h remains in the interior of this disk is the full-CSIT outage 
probability OUT(Full). The beamforming vector x resides on the sphere ||h|| = 1 
(not shown). The lighter shaded region in the middle is (9 X and the remaining two 
darker shaded regions constitute O x . Note that the regions O x and O x are in general 
separated by the two hyperplanes {h : (x, h) = yfa} and {h : (x, h) = — yfa} that are 
perpendicular to x. The two parallel lines in the figure represent these hyperplanes. 

Using the finite codebook versions of ([3]) and (jlj), the encoding regions given a 
quantizer codebook {x , . . . ,x 3 } will then be as shown as in Fig. [Tbl In the figure, 
£q comprises of the interior of the hexagon formed at the center, and the two half 
planes on the left and right sides of the figure. By Proposition [T], the probability 
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hi = oo 




(a) Outage (Ox) and no-outage (O x ) regions of x. (b) The encoding regions of a 4-level quantizer. 

Fig. 1: An illustration of the new encoding rule. 




Step Step 1 Step 2 

Fig. 2: A layered codebook structure. 



that h remains in the interior of the hexagon is the outage probability with the 
quantizer {x n ,£*, -}o<n<3- It is greater than the full-CSIT outage probability as the 
hexagon cannot "completely cover" the inner circle. Now, as shown in Fig. [21 at Step 
0, we start with the codebook {x , . . . ,x 3 } in Fig. [Tbl and at Step £, we add 2 e+1 
new beamforming vectors in between the ones we had in Step £ — 1. Repeating this 
process indefinitely gives us an infinite codebook {x n } with a layered structure. 

If we were to draw the codebook {x n } as we drew {x , . . . ,x 3 } we would observe 
that now HneN ^x coincides with ||h|| < a (up to a null set). This means that 
{x n ,£*, •} can achieve OUT(Full). We now specify the feedback binary codewords for 
each quantization cell. Let bg = e, = 0, b£ = 1, b£ = 00, b^ = 01, and sequentially 
so on for all the feedback binary codewords in {0, 1}*. We have L(b*) = [\og 2 (n + 1)J , 
and we consider the rate of the quantizer {x n ,£*,b*}. From our figure for the 
encoding regions on {x„}, we would also observe that the probabilities P(h e £*) 
decay rather fast (If we take our two-dimensional "paper world" to be exact, they 
decay as -%). We show that they in fact decay fast enough so that the quantization 
rate J2 n &N P(h £ ^rD^O 3 *) is finite. Our analysis reveals that the rate is bounded above 
by Co(^ + -pt ) for some constant C . In the following, we formalize these claims. We 
first construct a codebook that has the layered structure in Fig. [2J 
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C. A layered codebook 

For any £ G N, let St = { — 1 + ^fft, k — 1, . . . , 2 £+2 — 1}. For example, we have 
S = {— 1,0, \}, and «Si = {— |, — |, — |, 0, \, |, |}. For a given £, we construct a 
codebook 3^ of beamforming vectors by setting 

3^ = {y/||y|| :%6^, e 5/, i = 1, . . . ,t, and < ||y|| < 1}, 

where dtyi and denote the real and imaginary parts of respectively. For 
increasing £, Si provides a fine quantization of the interval [—1, 1]. The corresponding 
yt is roughly a product quantizer codebook, and thus provides an increasingly finer 
quantization of X BF as £ increases. In fact, the sequence of codebooks {3^}&eN looks 
like the sequence of layered codebooks in Fig. [2J with the index representing the 
layer. Formally, we have the following. 

Proposition 2. For any I 6 N, ^ C 3^+i> an d M < 2 2t ^ +2 \ Also, for sufficiently 
large £, Vh G * BF , 3y G y t , |(y, h>| 2 > 1 - § . 

Proof: The bound on |3^| and the fact that 34? C 3Vh> Vn G N follow immediately 
from the definitions. We now prove the last property. 

Let e = 2jtt- We can then rewrite Si = {—1 + ek, k — 1, . . . , - — 1}. For any real 
number x G [—1,1], we consider the scalar quantizer 

f -1 + ke, 3k G -1}, x G [-l + (Jfe-l)e,-l + fce) 

g(x) = <^ 0, x G [-e,e] . (5) 

[ -1 + (fc - l)e, 3k G {± + 2, . . . , f }, x G (-1 + (k - l)e, -1 + ke\ 

We can observe that for any x G [—1, 1], q(x) is well-defined with q(x) G Si, 

\q(x)\ < \x\, (6) 

and 

\q(x) — x\ < e. (7) 
The last two properties (EI) and (J7J) imply in particular that 

\x\ < \q(x)\ + e, (8) 

by the reverse triangle inequality. 

Now, for any given h = [hi ■ ■ ■ h t ] T G X BF as stated in the lemma, let z = 
[z\ ■ ■ ■ z t ] T be given by 

Slzi = q(JRh~i), Sszi = q($h~i), % = 1, . . . , t. (9) 

We have $lZi, $szt G Si. Let us now verify that in fact < ||z|| < 1. Suppose that 
||z|| = 0. Then, z is the all-zero vector, or equivalently qijfthi) = qC^shi) = 0, i = 
1, . . . , t by the definition of z. According to ([H]), we then have 

||hf = ^(|^| 2 + |^| 2 ) 

i=l 

<^(|g(^) + e| 2 + |g(^)+e| 2 ) 

i=l 
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= 2te 2 
2t 

~ 22(^+1) 
<1, 

where the last inequality holds for sufficiently large I. This contradicts the fact that 
||h|| = 1. On the other hand, if ||z|| > 1, according to (j7|) and ([H]), the inequalities 

K INI 2 

t 

y 

i=i 
t 



£(|^| 2 + |3^ 
i=i 

]T(|g(^| 2 +|g(^)| 2 ) 



8=1 

i 



<£ |^| 2 + |3^ 



i=l 
llhll 2 



lead to a contradiction. We have thus established dtzi,Qzi G 5^ with < ||z|| < 1. 
We now show that | (z, h) | 2 > 1 — p so that the last property in the proposition holds 
with y = z/||z||. For this purpose, let us first obtain a lower estimate for ||z|| 2 . By 
([H]) and ([H]), we have > — e, > \$shi\ — e, i — 1, . . . , t. Now, for any 
i G {1, . . . ,£}, if |3?/ii| > e, we have 

\Kzi\ 2 > (\&hi\ - e) 2 > |3^| 2 - 2\Wthi\e. 

Otherwise, if \3thi\ < e, |3ftzi| 2 = by the definition of q(-), and therefore, 

l^il 2 = o > \£K i \ 2 -2\$h i \e, 

as the function x 2 — 2xe is non-positive for all x G [0,2e]. Combining the two cases, 
the inequality 

\$tzi\ 2 > \m l \ 2 -2\mi i \e 

holds for any i G {l,...,t}. Noting that a similar set of inequalities holds for 
IQ^I 2 , i — 1, . . .,t, we obtain 



Ml 2 = £(l^l 2 + I^l 2 
«=i 

> (\®hi\ 2 - 2\Uhi\e + |Q^| 2 - 2|3^|e 

i=l 

t 

= 1 -2e£(|^| + 



i=l 

Subject to ||h|| 2 = 1, we have X^=i(l^«l + l^^il) — v^t with equality if and only if 
\&hi\ = \$fhi\ = Vz G {1, . . . , t}. Therefore, 

||z|| 2 > 1 -2\[2te. (10) 
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Moreover, according to (J7J) and (JHJ), we have 

||h- zf < 2te 2 . (11) 

We can now use the decomposition 

||h-z|| 2 = (h-z) t (h-z) 

= 1+ ||z|| 2 -29ft(h,z). 

Isolating 3?(h, z) and then using (fT0|) and (TTTi) . we obtain 

K(h,z) = i(l + ||z|| 2 -||h-z|| 2 ) 

> l - (l + (1 - 2^6) - 2te 2 ) 

= 1 - V2te-t^ 

<t <e 

> 1 - 2te. 

Therefore, 

| (h, z) | 2 > (»(h, z)) 2 > (1 - 2te) 2 > 1 - 4te. 

Letting y = p^, we have the claimed y G 3^ with | (y, h) | 2 > 1 — Ate = 1 — |f. ■ 

There is a quantizer codebook {y n }N with the property that W G N, Ul^o^lyn} = 
ye. In other words, the "first" |3^o| elements yo, . . . ,y\y \~i of {y n } form the set 3^o, 
the next |3^J elements of {y n } form the set y±, and so on. Such a set {y n } always 
exists since by Proposition [U y^ C 3^+i and each 3^ has finite cardinality. In fact, it 
is also straightforward to construct {y n } by setting {y , . . . ,y|y |-i} = 3^o> (It does 
not matter which element of y is set to be e.g. y as long as the equality holds), 

and {y^h • • • >y[y<+ii-i} = yt+i -yt,i> i- 

We thus have our easily constructable quantizer codebook {y n }- We now show that 
this codebook can achieve the full-CSIT performance with finite-rate. 



D. Main results 

Let {J^n} be defined as in (J3J) and (JH) with respect to {y n }- Also, let b* be as 
defined in Section UlI-BI We consider the quantizer Q* = {y n , J-" n ,b*}. 

Theorem 1. For any P > 0, we have 0UT(Q*) = OUT(Full) and R(Q*) < C (^ + pr), 
where Co is a constant that is independent of P. 

Proof: According to Proposition (TJ and for any £ G N, we have 0UT(Q*) = P(h G 
HneNCyn) < p (h £ f] y ey e ®y), since by construction, y e C {y„}. Now, 

P (h G H O y ] = P(Vy G y e , |(y,h)| 2 ||h|| 2 < a) < P f||h|| 2 < 

where h = h/||h|| and the last inequality follows from Proposition [2] for sufficiently 
large £. Since £ can be chosen arbitrarily large, we obtain 0UT(Q*) < P(||h|| 2 < a) = 
OUT(Full). Since, 0UT(Q*) > OUT(Full) is obvious, we have 0UT(Q*) = GUT(Full). 
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We need to estimate the probabilities P(h G J-" n ) in order to evaluate R(Q*). It is 
difficult to evaluate them individually, but as it turns out, we can estimate the "tail" 
sum-probability instead. In the appendix, we show that there is a constant £q > 1 
such that for all £ > £ , we have Y^=\y t \ P(h F n ) < Cia* /2 e , where Ci is a constant 
that is independent of n. For the remaining 1 < n < |3^ | — 1, we use the trivial 
individual bounds P(h G X" n ) < P(h G O yo ) = 1 — e~ a < a that in fact holds for any 
n > 1, where the first inequality is by the definition in (JH). These give us 

R(Q*) = £ P(h G F n )L(K) 

neN 
oo 

= E P (hG J- n )Llog 2 (n + l)J 

n=l 

I% |-1 oo 

= £ P(hG J- n )Llog 2 (n+l)J + 5: £ P(hG J- n )Llog 2 (n + l)J 

n=l €=€ n=|M 

l^ |-l oo 

<Liog 2 |^ IJ E p(hG j- n ) + ELiog 2 l^+ilJ E p(he^n) 

n=l £=£ n=|%| 

oo 

< «Llog 2 l^oiJ (l^ol - 2) + Cia* E Llog 2 l^+i|J/2', 

where for the first inequality, we have used the monotonicity of log 2 (n + 1), and for 
the second inequality we have applied the aforementioned tail sum-probability and 
trivial individual bounds regarding T n - The upper bound on |3^| in Proposition [2] 
implies that the sum in the last inequality is finite. This concludes the proof. ■ 
It is difficult to calculate the minimum rate that guarantees the full-CSIT per- 
formance. However, bounds can be given that determines how this minimum rate 
behaves with P. Such bounds are useful as one is usually interested in the medium- 
to-high P regime, where the outage probability is naturally low. 

Theorem 2. For any quantizer Q = {x n , £ n , b n }z with X C N and R(Q) G o(-p), we 
have OUT(Q) > OUT(Full) for sufficiently large P. 

Proof: Suppose that R(Q) < 1 (This holds by hypothesis for sufficiently large P). 
It is straightforward to show by contradiction that there is an index i 6 I such that 
P(h G £i) > 1 - R(Q). Without loss of generality, suppose that P(h G £{) > 1 - R(Q) 
and 1 G X. Then, with /(h) = ^e"" h " representing the PDF of h, we have 

0UT(q) = W i(|(x,,h)| 2 <«)/(h)dh 

> f l(|( Xl ,h>| 2 <a)/(h)dh 

= / 1 (|( Xl ,h)| 2 < a) /(h)dh - / 1 (|( Xl ,h)| 2 < a) /(h)dh 

> OUT(Open) - / /(h)dh 

J 8° 

> OUT(Open) - R(Q), 
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Since OUT(Open) G 0(p) and R(Q) G o(p), the final lower bound is ©(p), while it is 
well-known that OUT(Full) G 0(p>). This concludes the proof. ■ 
By Theorems [T] and [2] we thus conclude that the necessary and sufficient feedback 
rate to achieve the full-CSIT performance is ©(p). 

IV. Conclusions and Extensions 

We have identified a practical vector quantizer design problem where any fixed- 
length quantizer (FLQ) yields non-zero distortion at any finite rate, while there is 
a variable-length quantizer (VLQ) that can achieve zero distortion with arbitrarily 
low rate: In a point-to-point t x 1 multiple antenna system with quantized channel 
state information at the transmitter (CSIT), we have shown that there is a VLQ that 
achieves the full-CSIT outage probability performance with rate O(p). We have also 
shown that such decay of the feedback rate is P-asymptotically the best possible. 

An interesting problem is to determine the minimum feedback rate where the full- 
CSIT performance is possible. There appears to be a lot of room for improvement 
in this context. Indeed, using random vector quantizers, we can show that almost all 
infinite-cardinality codebooks with the encoding strategy presented in this paper can 
achieve the full-CSIT performance (the "bad" codebooks have zero measure). Due to 
space limitations, we shall discuss this issue in the journal version of this paper. 

Another extension is to investigate the performance with the more general preced- 
ing strategy. In precoding, one uses a txt precoding matrix X with ||X|| = 1 instead of 
a beamforming vector. An outage event occurs if ||Xh|| 2 < a. Using the beamforming 
vector x is thus equivalent to using the precoding matrix xxt In such a scenario, 
it can be shown that the necessary and sufficient feedback rate that guarantees the 
full-CSIT performance is ©(p?) instead. The achievability is the same as Theorem 
[T] with the first beamforming vector y in the quantizer codebook replaced by the 
identity precoding matrix. The converse follows the exact same arguments that are 
used in the proof of Theorem [2j 

Finally, note that we have allowed the use of non-prefix codes for the feedback 
binary codewords. These codes are well-suited for channel quantization purposes as 
one does not concatenate codewords for different channel states. On the other hand, 
the applicability of an empty codeword appears to be a gray area in practical systems. 
Our results can however be extended to the case where empty codeword is not allowed 
or even the case where only prefix-free codes are to be used. For example, for Theorem 
(H instead of the non-prefix-free code, one can use the prefix-free code discussed in 
Example El Then, Q* will have a feedback rate of 1 + 0(4) instead of 0(p). An 
extension of Theorem El then reveals that the 1 + 0(4) feedback rate is in fact 
asymptotically the best possible. 

Appendix 

Here, we estimate the tail sum-probabilities corresponding to the sequence {Fn}. 
Consider an arbitrary vector h G C* with ||h || 2 > at(l+ff). According to Proposition 
El for sufficiently large £, there is a vector y G 3^ with 

|( y ,ho)| 2 >||h || 2 (l-|). 
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Using the fact that ||h || 2 > a(l + If), we have, for sufficiently large 

3t\ / 2t\ 



/ t 6t 2 \ 



> ft, 



which implies ho G O y . In other words, for any h with ||ho|| 2 > ft(l + |f), there exists 
y G such that he Therefore, 

2l 



hGC':||h|| 2 >a(l + ^)[c |J O y . 

yey e 



(12) 



On the other hand, 



and therefore, 



{heC: ||h|| 2 < a} C O y , Vy G ^ 



BF- 



{hGC*: ||h|| 2 <ft}c f|<V 



(13) 



Now, 



\y e \-i m-i 

u ^=no»u u o° yi 

i=0 ieN i=0 

D \ h G C* : llhll 2 < a or llhll 2 > a (l + 



3f 

where the equality is by the definition of {J^n} in © and (jlj), and the last inclusion 
follows from (fT2"|) and f[T3"j) . This implies 



i=\y e \ 



i=0 



U U ^] C^hGC*:a<||h|| 2 <«(l + ^)^. 



3f 



Therefore, 



P ( h G (J Ti ) < 



"57 J x e 



r(t) 



-dx 



< 



«(i+ff) 



24 „t-i 



a' 
T 
3a* 
t2< 



x dx 



3t 



1 + ^7 



I n - 1 ) •-!- (!-! 



3t 

2* 



t-r 



<t+l for sufficiently large € 



< Gi- 



ft 



where the last inequality holds for sufficiently large £, and Ci is a constant that is 
independent of I. 
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